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(54) Character and image processing 

(57) An image processing method 
comprises the steps of storing in a 
memory (4) image data derived by 
scanning (3) an originaL Characters 
generated in a word processor (12) are 
arranged in a processor (15) so that 
character and Image data occupy diffe- 
rent areas of a reproduced composite 
image. 

The image memory (4) may store one 
page of data and may be linked with a 
disc store (5) for storage of more pages 
of data. These may be printed serially 
on the same sheet. 

Also disclosed is apparatus for re- 
feeding a printing sheet so that it is 
printed on both sides, and for con- 
trolling the position of the sheet to 
select the reproduced image position. 
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SPECIFICATION 

Image processing method or apparatus . 

5 Background of the invention 
Field of the invention 

The present Invention relates to an image data 
processing method or apparatus. 

10 Description of the prior art 

A typical example of an image processing appar- 
atus according to the prior art is illustrated in Figure 

An original 1 is read by an image reader 3 and 
1 5 converted into digital signal. The digital signal of the 
original image is stored in an image memory 4. The 
image data are provisionally transferred into an 
external sub-memory such as disk 5 to form a data 
file for^urther processing the data for edition. 

20 Processing for edition is carried out in an image 
processor 6. The image processor extracts a neces- 
sary portion of data from the data in the external 
sub-memory 5 and determines the arrangement of 
images finally required. After determining the image 

25 arrangement, the data are transferred into the Image 
memory 4. The work necessary for image arrange- 
ment and confirmation of the determined arrange- 
ment is conducted by using an input-output appar- 
atus of a display 8 and a wright pen 9. Data already 

30 processed and transferred into the image memory 4 
are sent out to an image printer 7 where the 
processed image data are printed out as a record 2. 

In the prior art apparatus of the type mentioned 
above, an image processed record can be obtained 

35 solely from the original image already read out by 
the image reader. It is difficult to add other image 
data afterwards. Although such addition of other 
data is not impossible, it involves a very complicated 
work for determining the layout in edition, in 

40 addition to the works for reading of document and 
input of said other image data to be added. 

Another disadvantage of the above prior art 
apparatus is found in difficulty in putting a necessary 
correction. For example, if there is any miswritten 

45 word in the original document or any dirty letters are 
found in the read document or the layout of 
sentences determined by the image processing is 
made different from that of the original document, it 
is wished to put the necessary correction in the 

50 document portion. However, in the prior art appar- 
atus, such correction is not allowable. Even if 
allowable, a very long time is required to^make the 
corrections, which in turn reduces the efficiency of 
operation to great extent. 

55 The use of sub-memory such as disk brings forth a 
drawback. The speed of data transfer in forward 
direction and backward direction is limited by the 
operation speed of such disk memory. No high 
speed processing is attainable. Furthermore, the use 

60 of external sub-assembly necessitates a time and 
labour consuming registration and reference. 

Since, in the conventional apparatus, a plural 
number of document images are continuously 
copied, it is required to carry out the exchange of 

65 document in synchronism with the continuous 



copying operation. This makes the apparatus very 
complicated. 

Summary of the invention 
70 Accordingly, the present invention aims to provide 
an image processing method or apparatus which 
substantially alleviates the above disadvantages and 
drawbacks of the prior art. 

In one aspect the invention aims to provide an 
75 improved image processing method or apparatus 
which enables to compound a document read image 
and a word input image. 

In another aspect the invention aims to provide an 
image processing method or apparatus which en- 
80 ables to edit images with higher efficiency. 

In a further aspect the invention aims to provide an 
image processing method or apparatus in which the 
position or area where one image data is reproduced 
never interferes the position or area for another 
85 image data. 

In a still further aspect the invention aims to 
provide an image processing apparatus in which 
image data can be processed at high speed and 
therefore with an improved efficiency. 
90 In another aspect the invention aims to provide a 
copying method or apparatus which enables to print 
images of a plural number of pages of document 
serially. 

In a still further aspect the invention aims to 
95 provide a method or apparatus which enables to 
copy read images on both side surfaces of a sheet. 

Other and further objects, features and advan- 
tages of the invention will appear more fully from 
the following description of preferred embodiments 
100 with reference to the accompanying drawings. 

Brief description of the drawings 

Figure 1 is a diagrammatic view of an image 
processing apparatus according to the prior art; 
105 Figure 2 is a diagrammatic view of an image 
processing apparatus according to the invention 
showing an embodiment of the invention. 

Figure 3 illustrates an example of image edition; 

Figures 4- 7 and 4-2 are detailed views of the 
110 control circuit in the apparatus shown in Figure 2; 

Figures 5- / and 5-3 are flow charts of the control; 

Figure 6-3 is an illustration of coordinate-address 
conversion; 

Figures 6A and 68 show another example of 
115 image edition; 

Figure 7 shows a further example of image 
edition; 

Figures 8- 1 and 8-2 show a copy obtained there- 
from; 

1 20 Figure 5 is a sectional view of a copying machine 
to which the present invention is applicable; and 

Figure 10 is a flow chart of the control for the 
example shown in Figure 7. 

125 Description of the preferred embodiments _ 

I Referring to Figure 2 showing an embodiment of ^ 
the present invention, reference numeral 1 desig- 
nates an original which may be, for example'^ a photo 
picture of Figure 3 is an image reader for reading the 
130 original 1 and converting the read Images into digital 
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signals. The image reader 3 comprises a known line 
scanner such as CCD and a driving apparatus for 
moving the scanner in the secondary scan direction. 
Image data read by the image reader 3 are stored in 
5 an image memory 4. The image memorv 4 comoris- 
es a known semiconductor page memory having a 
capacity enough to store one page amount of image 
data. 5 is an external sub-memory for storing a large 
amount of data from the image memory 4 as a data 
10 file. The external sub-memory 5 comprises a known 
magneto disk and means for access to it. 12 is a 
known word processoLf or producing a sentence. 
The word processor 12 contains a keyboard 13, a 
display 14 and a sentence memory 10. The sentence 
1 5 memory 10 comprises a known semiconductor 
memory having a capacity enough to store such 
amount of data corresponding to one page of print. 
1 5 is an image processor for compounding and 
editing data f romjhe image memory 4, external 

20 sub-memory 5 and word processorJ2. The image 
processor also performs editinc of sentence da ta 
from the word processor 12 for starting new para- 
graph at the same time. The image processor 1 5 
contains an edited data memory 1 1 comprising a 

25 known semiconductor memory. The content of the 
edited data memory 1 1 corresponds to the final print 
image then desired. 7 is an image printer fee^printing 
for printing out the data processed by the image 
processor. The image printer is a known laser 

30 printer. 2 designates a record having images edited.^/ 
A, B, C, D, E, F and G designate data buses for image 
and sentence. The data bus G is also useful for data 
communication through a communication circuit, a 
designates a control signal line for controlling every 

35 part in selection of the part etc. Other parts of the 
apparatus correspond to those of the apparatus 
shown in Figure 2 and need not be further described. 

Figure 3 illustrates the manner of image edition 
employing the embodiment shown in Figure 2. 

40 Figure 3A shows an original image such as a photo 
picture or a figure to be read by the Image reader 3. 
Xi and Yi indicate the position and area of the 
original image. Figure 38 shows a sentence made by 
the word processor 12. The sentence thus made is 

45 stored in the sentence memory 10. Figure 3C shows 
an example of the layout of image and sentence as 
required after image edition. The manner of opera- 
tion of the apparatus for this example is as follows: 
The image reader 3 shown in Figure 2 reads the 

50 original picture image shown in Figure 3A. The - 
image memory 4 stores the image data. Image area 
and its position, Xi and Yi corresponding to (XI, 
YI )(X2, Y2) of the image memory. White and black of 
the image part are stored as "0" and "1", respective- 

55, ly. If the image has to be stored for a long time, then 
it is transferred into the external sub-memory 5 to 
keep it in memory as a data file. 

The sentence data shown in Figure 38 is such data 
made up by the word processor 12. A sentence clear 

60 in meaning is an example of such sentence data. The 
data is^ut in by the keyboard 1 3 as character code. 
After being made up to a complete sentence, the 
data Is stored at (X3, Y3), (X4, Y4) in the sentence 
memory 10 shown in Figure 2. 

65 The image processor 9 in Figure 2 converts Xi and 



Yi indicating the image position and area into the 
coordinates of (X'l, Y'1), (X'2, Y'2) and then deter- 
mines the coordinates of the sentence insertion area 
(X'3, Y'3}, {X'4, Y'4) to obtain the final image 

70 arranged as shown in Figure 3C. This processing is 
carried out in the following procedure. 

As previously described, the image processor 15 
contains an edited data memory designated by 1 1. 
The converted coordinate positions are allocated to 

75 the corresponding positions oif the memory 1 1 so 
that the positions for arrangement of the image data 
and the sentence data are determined. The image 
processor 1 5 dispatches a processing instruction 
signal a to transfer the image data existing between 

80 the areas (XI, YI ) and (X2, Y2) from the image 
memory 4 or the external sub-memory 5 into the 
area (X'l, Y'1)(X'2, Y'2) in the edited data memory 
1 1 through the data bus E. 
As for the sentence data, the image processor 1 5 

85 calculates and evaluates the number of characters 
existing in the insertion area in the edited data 
memory 1 1 defined by (X'3, Y'3} and (X'4, Y'4). 
Then, it indicates the number of characters which 
can be transferred up to the point (X'4, Y'4|. This 

90 prevents any character image from entering the area 
of read image. Thereafter, the image processor 15 
transfers data to the above defined area in the 
memory 1 1 from the sentence memory 10 in the 
word processor 12 through data bus G while starting 

95 new line without changing the number of characters 
in one line by the new line starting function of the 
image processor 15. In this manner, the position for 
reproducing the read image can be determined with 
first priority. Also, it is made possible to edit the 
100 character image in an area other than the area used 
for editing the read image. 

After the above processing and editing, the edited 
data memory 1 1 has the corresponding image data 
and sentence data at the determined positions and in 
105 the determined areas corresponding to X'i and Y'i. 
This content of the memory 1 1 is transferred to the 
image printer 7 through the data bus F. Thus, an 
image edited record 2 can to obtained. 
The above embodiment will be described further 
^^Q in detail hereinafter with reference to Figures 4 and 

Li 

In Figure 4-1 showing the details of the apparatus 
shown in Figure 2, the image processor 1 5 is 
constituted of CPU, ROM, RAM etc. which may be, 

115 for example, of a known microcomputer. ROM has a 
program as shown in Figure 5 stored therein. By 
executing the program, the above described process 
of processing image data is controlled. Data buses 
shown in Figure 4-1 correspond to those designated 

1 20 by A-G in Figure 2. The address t}uses are lines for 
setting addresses of the respective memories and 
the like. The coordinate input apparatus 9 is used to 
set position for image processing. The input appar- 
atus 9 is a known digitizer or keyooard. Other input 

125 apparatus also may be used as the coordinate input 
apparatus 9 so long as it is aole to tnoicate points on 
a coordinates. For exdrnpte, a write pen or a cursor 
on Braun tube may be used. 
RAMI is an image area memory for storing data 

130 {XI , YI I (X2, Y2) indicative of the nosition nnrj area 
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of the read image in the memorY 4. RAM2 is a 
memory for storing data (X'1, Y'1) Y'2) indica- 
tive of the position and area for reproduction of said 
read image. RAM3 is a memory for storing data {X3, 
5 Y3)(X4, Y4) indicative of the position and area of the 
sentence image in the memory 10. RAM4 is a 
memory for storing data (X'3, Y'3)(X'4, Y'4) indica- 
tive of the position and area for reproduction of said 
sentence image. Data of RAM4 is determined de- 

10 pending on the data of RAM2. But, it is also possible 
to determine the data in RAM4 by the input appar- 
atus 9. Data of RAMI , RAM2 and RAM3 can be 
determined by the input apparatus 9. Memories 4, 10 
and 1 1 are refresh type DRAM (dynamic RAM). 

1 5 Figure 4-2 shows a concrete example of CPU 
shown in Figure 4-1. The concrete example is the 
structure of HMCS 68000 supplied by Moto Roller or 
Hitachi. The structure is described in detail in its 
manual and therefore need not be described herein. 

20 The manner of operation of the above shown 
apparatus will be described hereinafter with refer- 
ence to the flow chart shown in Figure 5. The flow 
described hereinunder is the program stored in ROM 
in Figure 4-1. 

25 The image reader reads an original document (1 ) 
and the read image is stored in the image memory 4 
as image data (2). On the other hand, the position 
data of the necessary image portion (XI, Y1)(X2, Y2) 
are introduced into the apparatus by the coordinate 

30 input apparatus 9 (3). To make the position data 
correspond to the original, the input of position data 
may be carried out by placing the original on a 
digitizer and plotting the apexes of the desired area. 
The position data is provisionally stored in the image 

35 position information area data memory RAMI within 
the memory RAM of the image processor 15 shown 
in Figure 4-1 . If the input of position data is carried 
out using not a digitizer but a keyboard, then the 
position Xi, Yi may be set also by previously making 

40 a correspondency between actual size and key input 
value. The input of position data can be carried out ' 
before or after reading the original image. When a 
standardized image is read.or when an image in the 
same position is read many times repeatedly, such 

45 image may be stored and fixed in ROM. 

The image memory 4 is constituted of a semicon- 
ductor memory using a dynamic RAM. To store all of 
the sizes in A4 format as digital values, the image 
memory4hasacapacity of 210 x 297 x 16 = 997920 

50 bits provided that it has a resolving power of 1 6 
pel/mm bit density for 210 mm (length) x 297mm 
(width). To set Xi, Yi position of the original 1 from 
among the memory, CPU carries out acJdress setting 
of the image memory (area coordinate — address 

55 conversion). Reading and writing of the image are 
conducted by the address. The correspondency 
between nriemory address and position Xi, Yi is 
obtained by computing the memory address corres- 
ponding to the previously plotted Xi, Yi within CPU. 

60 Let Xi be 210mm in length. Then, the width of 
address data value to be set Will be 0 - 3360 bit. 
Similarly, when Yi is 297mm in width, the width of 
address data value if 0 - 4752 bit. CPU issues 
therefore address value up to 997920 to set the 

65 address for the combination of Xi and Yi. The 



address conversion and image data transferring 
described above are executed at steps after step 1 1 . 
While, in this example, the position of the original 
has been stored in data RAM in terms of Xi, Yi, it is 

70 also possible to use means for converting the size 
indicated by a digitizer into an image memory 
address and make the memory address stored in the 
data RAM keeping the correspondency between size 
and address. Furthermore, it is also possible to issue 

75 the address of Xi, Yi from CPU and convert it into 
memory address on the side of the image memory. 
To this end, Xi, Yi address is previously put in 
through an address setting line of ROM by the 
address conversion circuit of ROM and an image 

80 memory address corresponding to the address input 
is previously given as ROM data. r 

At the next step 4, the word processor 1 2 produces 
a sentence which is to be compounded with the read 
image (4). This is done by keyboard input. The 

85 arrangement of characters in the sentence is auto- 
matically determined in such manner as to allot an 
area other than the area of the read image to the 
sentence and suitably start new line. Therefore, man 
need not worry about the form of the sentence. If it is 

90 a standardized sentence, then the sentence may be 
advantageously stored in ROM or in a disk device to 
use it whenever necessary. There is no need of 
worrying about the arrangement irrespective of 
what image is to be compounded with the sentence. 

95 This is a particular advantage of the present appar- 
atus. 

The input character codes are converted into 
picture element data by a character generator within 
the word processor 12 and then transferred into the 

100 sentence memory 10 (5). The sentence memory 10 is 
of the same structure as the image memory 4 and is 
connected to CPU. However, since the sentence 
character does not require so high revolving power 
as the image does, the sentence memory may be 

105 formed with a lower memory capacity than the 

image memory. To expand the produced sentence to 
determined positions as data, the position data of 
(X3, Y3)(X4, Y4) are put in by the coordinate input 
apparatus 9 (6). RAM3 of the sentence area RAM 

110 shown in Figure 4-1 stores the input position data as 
area data. The coordinate data of (X3, Y3)(X4, Y4) 
may be, of course, introduced even before the 
production of the sentence to expand the character 
data to the memory addresses corresponding to the 

115 set positions of the sentence memory during the 
production of the sentence. However, since the word 
processor naturally contains an indirect buffer mem- 
ory therein to assure an easy production of sentence, 
it is the best way to carry out the input of the 

120 coordinate data after producing the sentence. 

At the step 5 subsequent to the production of the 
sentence, the input of the position data (X' 1 , 
Y'1 |(X'2, Y'2), (X'3. Y'3)(X'4. Y'4) for arranging the 
image and the sentence is executed. The image 

1 25 position data is stored in RAM2 of the image data 
area RAM and the sentence position data is stored in 
RAM4 of the sentence area RAM. to prevent the 
image data and the sentence data from overlapping 
each other on this position setting, CPU computes 

130 the area data of RAM2 and RAM4 to perform an 
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automatic alteration of sentence position {8K (9). To 
this end. Y'2 of the converted position data of the 
read Image in RAM2 is compared with Y'3 of the 
character image (8). Only when Y'3 is larger than 
5 that Is, the character image position lines out of 
the area of the read image, the step is directly 
advanced to the step of transferring image data. If it 
is desired that Y'3 is smaller than Y'2, that is, the 
character image position lies within the area of the 

10 read image, then Y'3 is subtracted from Y'2 and the 
amount of line corresponding to the difference is 
registered in a register A. Further, the data of A is 
added to Y'3 so as to make a new line start with line 
shift-down by A. 

1 5 After completing the above step, CPU converts 
(X'1, Y'1 1 of RAM2 into address and indicates the 
address to the edited data memory 1 1 to instruct the 
start point of image data writing. Then, Image data 
value at the position indicated as the address of (XI , 

20 Y1)in .RAIV11 is transferred from the image memory 4 
to the edited data memory 1 1 at the indicated start 
point. This operation is repeated up to the address of 
(X2, Y2) to perform the necessary image extraction 
and position alteration. In this manner, only the 

25 image part is transferred into the edited data mem- 
ory 11 (11 - 17). More particularly, these steps are 
carried out in the following procedure: 

At first, data of (XI , Y1 ) in RAM 1 is transmitted to 
the register A of CPU (1 2). A discrimination is made 

30 as to whether or not the content of the register A is 
equal to (X2, Y2) (13). When it is not, the content of 
the register A is converted into address data and 
transferred to a register B according to the method 
illustrated In Figure 5-2(14). Data of (X'1, Y'1) in 

35 RAM2 is also converted into address data and 
transferred into a register C (1 5). Then, the image 
data indicated by the register 8 is transferred into the 
address of memory 1 1 indicated by the register C 

(16) . 1 is added to XI, X'1 and also upon the end of 
40 one line address conversion 1 is added to Y1, Y'1 

(17) .Thesedata(X1,Y1) + l.(X'l,Y'1) + lare ' 
transferred into the register A and a discrimination is 
made as to whether or not thecontent of the register 
A reaches X2, Y2 (13). If not, the above procedure is 

45 repeated until it reaches X2, Y2, When it reaches X2, 
Y2, CPU carries out address conversion of (X3, Y3) at 
RAM4 similarly to the above and indicates the 
address to the edited data memory 1 1 as the starting 
point of sentence data writing. Data RAM3 takes up 

50 the sentence data value at (X3, Y3) address from the 
sentence memory 4 and transfers it into the edited 
data memory 1 1 at the indicated staning point. This 
operation is repeated up to the address of (X4, Y4) 
and only the sentence part is transferred into the 

55 data memory while carrying out the necessary 
alteration of the sentence position (18 - 23). The 
conversion routine shown in Figure 5-2 is carried out 
starting from the top on the left side of the memory 
as (Xi, Yi) — 0 and along the arrow keeping the 

60 correspondence to address as shown In Figure 5-3. 
The respective memory outputs are compounded 
by OR logic and put into the edited data memory 11. 
Therefore, the content of the memory appears as 
that shown in Figure 3C. In this manner, a composi- 

65 tion of image and sentence is attained. To prevent 



any overlap of memory addresses, selection of 
memory is made by changeover of the select 
terminal by select lines. Before starting the operation 
(at the program start step), all of the data in the 

70 edited data memory 1 1 are cleared. Therefore, there 
remains only background data (for example. 0) for 
the area other than the image and sentence portions 
as defined by Figure 3C. Thus, there can be formed 
white or black background part by the background 

75 data. 

Obviously many modifications and variations of 
the above embodiment are possible in the light of 
the above teachings; 
In the above example, data area of the image and 
80 sentence before and after alteration of position have 
been determined by sening position only. However, 
it is also possible to determine the data area by 
suitably setting the first point and the amount of 
data. Also, in the above example, the data area 
85 before alteration of position and that after alteration 
of position have been the same. However, it is also 
possible to change the data area. While the position 
of character image has been automatically deter- 
mined by indicating the final arrangement of the 
90 read image, it is also possible to automatically 

determine the position of the read image by indicat- 
ing the position of the sentence. Further, even when 
an sentence is arranged between two image parts, 
the position of the sentence in such arrangement can 
95 be determined automatically by computing opera- 
tion of CPU. In this case, data of RAM4 in the 
sentence area RAM are so made as not to interfere 
with the read image. To this end, CPU subtracts the 
size in Xi-direction of the image part from the full 

100 width in Xi-direction and at the same time calculates 
the remaining width of the sentence part to make 
new line start at the most suitable point. 
^ As readily understood from the foregoing, the 
present invention enables to compound image data 

1 05 and character data. Since there is used a word 

processor to make sentence data and the sentence 
data exist as character codes of the respective 
characters constituting the sentence (for example, 
JIS key cord etc.), rearrangement of sentence, 

110 insertion of word, correction of wrong word, line 
shift etc. can be carried out at will. This makes it 
possible to arrange the sentence in the area other 
than the area for the image part with a higher 
efficiency when editing a combination of image data 

115 and character data. It enables also to easily arrange 
the sentence in a place easy to see. Further it has 
another advantage that a communication circuit can 
be used as data transmission line for data from the 
word processor. Therefore, image processing can be 

120 carried out using sentence oata from a word proces- 
^sor at a remote place. 

In the above description with reference to Figure 2 
embodiment, the external suD-memory 5 has been 
shown and descnoea as a memory used only for 

1 25 image oata. However, it will be obvious that the 
external sub-memory may be used for storing 
character data wnen a large amount of charac!c» 
data are transferred from the word processor atl 
once. In this case, me image orocessor process'*" 

130 data as character coae correctioh of character jm'I 
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rearrangement of sentence can be carried out in the 
same manner as above because the external sub- 
memory can store the data as character code data. 
Therefore, this constitutes another embodiment of 
5 the invention. 

Hereinafter, description will be made of an exam- 
ple in which two portions of the same original image 
are changed in arrangement and then printed. This 
example is described with reference to Figures 6A 
10 and6B. 

Figure 6A shows an original to be processed. P1 
and P2 are two different portions of the original. 
Figure 68 shows a design of rearrangement to be 
obtained by image processing the original shown in 

1 5 Figure 6A. PI ' and P2' correspond to PI and P2. But, 
the arrangement of PI ' and P2' is different from that 
of PI and P2. In this example, therefore, it is wished 
to shift the image portion PI to PI ' and P2 to P2'. 
Image area of the portion PI is defined by {XI, Y1 ) 

20 and (X2, Y2) with the left and upper apex being taken 
as a point of origin. Similarly, image area of P2 is 
defined by (X3, Y3) and (X4, Y4). In Figure 6B, image 
area of PI ' after rearrangement is defined by (X'1, 
Y'1 )(X'2, Y'2) and that of P2' by (X'3, Y'3)(X'4, Y'4}. 

25 The image is printed in the position shown in Figure 
SB. 

The image reader 3 previously described reads the 
original to be image processed and puts out image 
signals in the form of digital signal into the data bus 
30 B. 

The image memory 4 (first image memory) re- 
ceives the signals and stores the read image data as 
"0" for white portion and as "1" for black portion in 
accordance with the image positions of the original. 

35 The image processor 1 5 carries out coordinate- 
address conversion for all or a desired portion of the 
image detail in the memory 4, The address con- 
verted data are transferred into the memory (second; 
memory) 1 1 which stores the data. Image area 

40 stored in the first memory and imajge area stored in 
the second memory are shown in Figures 6A and 6B 
respectively. As the first and second memories 4 and 
1 1 there are used semiconductor memory RAM. 
Therefore, data transfer can be carried out at a high 

45 speed. In particular, by employing DMA system of 
CPU a high speed data transfer can be carried 
directly from the data bus E. 

Since the image shown in Figure 6A is that stored 
in the first image memory 4 shown in Figure 2, the 

50 image data in the memory 4 correspond to the 
image portions PI and P2 enclosed by the corres- 
ponding position coordinates in Figure^A. Similarly, 
the image data in the second memory 1 1 correspond 
to the image portions PI ' and P2' in Figure 6B. 

55 The position coordinates data Xi, Yi of these PI , 
P2. PI ' and P2' are read by display 10, digitizer 9 and 
image processor 15 and stored in RAMI - RAM4 
shown in Figure 2 in the procedure shown in Figure 
5. In the case of this example, the control flow can be 

60 realized by omitting steps 4 - 6 in Figure 5-1 and 
adding the steps of input discrimination of (X3, Y3) 
(X4, Y4) and RAM setting to step 4, Following the 
above steps, coordinate-address conversion and 
image data transfer are carried out in the same 

65 manner as described above so that the images Pi , 



P2 in the first memory are transferred into the 
second memory 1 1 as images PI ' and P2'. A copy as 
shown in Figure SB is obtained by sequentially 
putting out the image data from the memory 1 1 to 

70 the printer 7. . 
As described above, when there are used two 
image memories, namely a first image memory for 
storing, at high speed, the read image data of an 
original to be processed and a second image 

75 memory for spreading the processed image data, 
rearrangement, deletion and addition of image can 
be carried out without the aid of any external 
memory. Therefore, a further improvement of data 
transfer speed and processing efficiency can be 

80 attained. 

As another embodiment, two image memories 
can be used together with an external memory 5 in 
Figure 1. In this embodiment, data are extracted 
from the external sub-memory 5 while making a 

85 reference to the image data in the first image 
memory 1 and the image data are spread in the 
second image memory 2. In this manner, the use of 
two image memories makes it possible to perform 
reference image processing and further improve the 

90 efficiency of image edition. 

The capacity of image memory is never limited to 
that of two pages only. The image memory can be 
provided with a higher capacity more than two 
pages. 

95 According to the method of the present invention, 
a plural number of images can be printed serially. An 
example of such printing is described hereinafter 
with reference to Figure 7 and 8. 
In Figure 7, books (1 ), (2) and (3) are laid on a table 

1 00 with their pages A4o - A45 open. The image reader 3 
reads these pages of books (1 ), (2) and (3). The read 
original images are transferred into the image 
memory 4 which is able to store two pages in A4 
format of amount of data at once as A3 format size. 

105 The external sub-memory 7 stores the read original 
for a long time as data file in one page unit. From the 
external sub-memory, data can be extracted in page 
unit whenever necessary. The image processor 1 5 
can process the necessary two page images for 

1 10 composition. It compounds data of one page in the 
external sub-memory 5 and data in the image 
memory 4 or compounds data of two pages in the 
external sub-memory 5, and then puts out the 
compound images serially. The image printer 7 

1 1 5 sends out the composition-processed content of the 
image memory 4 serially to record it on a paper of A3 
format. 2-(1 )' and (2)' are records thus obtained. The 
record 2-( 1 1' is a recording paper of A3 format 
having images of (A4o', A4t') and the record 2-(2)' is 

120 that having images of (A42', A43'), A4o' means a 
copy of the page A4o of the book 1 -( 1). The same 
applies to other similar symbols. 

At first, pages A4o and A45 of book 1 -(1 ) are read 
by the image reader 3. The read original is transfer- 

1 25 red into the image memory 4 as image signals. A4o 
and A45 are registered at the areas M, and M? of the 
image memory 4. The content of image memory 4 is 
transferred into the external sub-memory 5 after a 
file number being affixed to every page by the image 

130 processor 1 5. 
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The above operation is repeated also for book 1-(2) 
and 1 -(3) to form a data file of the book 1 in the 
external sub-memory 5. After completing the repeat- 
ing operation, the image processor 1 5 transfers the 
5 first stored data of page A4o from the external 
sub-memory 5 to the image memory 4 at its area Ml. 
Similarly, the next data of page A45 is transferred to 
the next area M2 of the image memory 4, The data in- 
the image memory 4 are serially sent out to the 

1 0 image printer 7 so that a record as shovyn in 2-(1 )' is 
obtained. In the same manner, pages A42 and A43 
are copied to form a record 2-(2)'. 

As seen in Figure 7, the record of 2-{1)' having A4o' 
and A4/ and the record of 2-(2)' having A42' and 

15 A43' are contained each in one paper sheet of A3 
format. 

The copied originals are folded back along the 
center line of each the sheet with each page upward 
and bound at H as shown in Figure 8-1 . 

20 When the bound records are opened wide, AA^" is 
on the left-hand side and A42'' is on the right-hand 
side, which is entirely the same as the original 1 -{2) 
(Figure 8-2). 
According to the above embodiment, original 

25 images can be copied maintaining the same 
arrangement of pages as in the original book and 
with good efficiency. Thus, a copy easy to see can be 
provided. 

In addition, it is possible to correct any mis- 

30 arrangement of pages in the original or insert any 
relevant page extracted from the file. 

The process control necessary for obtaining the 
above mentioned copies can be carried out accord- 
ing to the flow chart shown in Figure 10 (later 

35 described) with the exception that the steps 6 and 9 
are replaced by a time delay step for providing a 
marginal to fold back on the copy sheet. More 
particularly, data of A4o' are put out from the 
memory 4 (4) and a discrimination is made as to 

40 whether or not all line output in one page amount of 
A4o' is completed (5). If not, the output is repeated 
until all line output is complejted. This discrimination 
can be performed by line counting 210mm x 16 
pel/mm by the image processor 1 5 and detecting the 

45 end of count. Upon completion of one page amount 
of output, a predetermined blank time is given and 
thereafter data output from the memory 4 is carried 
out ( 1 0, 1 1 ). Thus, a copy of two pages can be 
obtained on one copy sheet of A3 format with a 

50 margin to fold back between the images A4o' and 
A4/. 

The method of the present invention is applicable 
also to such case wherein image is formed on both 
sides of one copy sheet. 

55 Before entering the description of an example of 
such both.side copying, we will describe an example 
of copying machine provided with an image printer 7 
which is applicable to all of the above examples. 
In Figure 9, there is shown such an example of 

60 copying machine. An original laid on a platen 1 is 
illuminated by a lamp 52 and scanned by mirrors 53 
and 54 moving in the direction of arrow. 80 desig- 
nates a reflected image formed by the slit scan. The 
reflected image 80 forms an image on the photore- 

65 ceptor part of CCD 3 through a lens 55. The image is 



converted into an electrical signal every slit line by 
self scan of CCD and stores in a memory 4 through a 
buffer in the manner described above. In response to 
an output start signal, data are read out from the 

70 memory 4. Through a buffer the read data mod- 
ulates a beam 81 from a laser oscillator 58. The beam 
Is deflected upon a polygon mirror 59 to beam scan a 
rotating photosensitive drum 61. Thus, as electrosta- 
tic latent image is formed on the drum. The electros- 

75 tatic latent image on the drum is developed by a 
developing device 65 and the developed image is 
transferred onto a sheet of A3 or A4 format fed from 
a cassette 68. The image on the sheet is then fixed by 
a set of rollers 69. The sheet is echausted from the 

80 machine into a tray 70. The drum Is cleaned up by a 
cleaner 71 for reuse. When a both side copy is 
desired, a pawl 101 is turned up on completing the 
copy on the first side of the sheet so that the fixed 
copy sheet is not exhausted from the machine but 

85 transported to an intermediate tray 1 00 for waiting. 
With the start of beam scan on the image of the next 
page, the sheet is sent out from the intermediate tray 
100 in a determined timing to transfer the image of 
the next image onto the second side of the sheet 

90 from the drum. Until this time point, the pawl 101 Is 
again turned down to its original position. 

Hereinafter, the manner of control on a both side 
copying process will be described with reference to 
Figures 7 - 10. The flow shown in Figure 10 is 

95 executed by the image processor 1 5 shown in Figure 
2. 

As previously described, each page of a book 1 in 
size of A4 format is read and the read original is 
stored in the memory 5 as a data file (1 ), (2). After the 

100 above operation, discrimination is made as to 
whether or not the data store is completed or as to 
whether or not the start signal is issued (3). When 
"Yes", the first stored A4o page data is transferred to 
area Ml of the image memory 4 from the external 

1 05 sub-memory 5. Similarly, A4i page data is transfer- 
red to the next area M2 of the image memory 4. 
Among data in the image memory 4, data at Ml is at 
first sent out to the image printer 7 (4|, (5) to print it 
on the top side surface of a copy paper of A4 format. 

1 1 0 The copy sheet carrying a print on its top surface is 
transported to the intermediate tray 100 where the 
copy sheet is turned inside out. The reversed sheet is 
again sent out from the intermediate tray 100 toward 
the transfer station. The image processor 1 5 discri- 

1 1 5 minates whether the copy sheet is exhausted from 
the intermediate tray or not by means of a sheet 
sensor 102 (6). After confirming the sheet exhaust 
from the tray 100, data at M2 of the image memory 4 
is transferred to the image printer (10). (11) to print it 

1 20 on the backside surface of the copy sheet. Thus, 

there is obtained a both side copied record as that of 
2-2-(l)' in Figure 7. If no sheet exhaust from the 
intermediate tray 100 is detected, it is regarded as 
occurrence of a jam trouble (7) and copying opera- 

125 tion is inhibited until a jam reset key is turned on (8). 
Upon resetting, output of data A4o' is again started 
' to repeat copy makrng on (he top side of copy paper. 
At step 12 a discrunuidiion is made as to whether or 
not the copy sheet already copied on the both sides 

130 is jammed, by means ot a sheet sensor 103. 
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If no sheet is detected at the time when output of 
data at M2 is completed, then the step is turned 
toward jam routine J. After jam resetting, data 
output of A4o' is again started to continue printing. 
5 When a sheet exhaust from outlet is detected, data 
of the next two pages are transferred from the file 
memory 5 to the image memory 4. In the same 
manner as above, pages AAj and A43 are copied to 
produce a record as that of 2-2-(2)' in Figure 7. The 

10 records (1)' and (2)' of 2-2 thus obtained are bound 
together at H as shown in Figure 8. When the bound 
records are opened wide, the image A4,'' is on the 
left-hand side and A42" is on the right-hand side. This 
arrangement of pages is entirely the same as that of 

15 the original 1-(2). 

In this manner, a copy having the same page 
arrangement as that of the original can be obtained 
without need of folding work. Such copy is very easy 
to see. Many variations of the above embodiment 

20 are possible. In the above embodiment, at the first 
reading step, A4o page and A45 page of the book 
original 1-(1) have been read at once. After reading, 
the image data have been sent out from the image 
memory to the image printer while separating one 

25 page from the other page. However, it is also 

possible to carry out copying operation every read- 
ing and carry out page arrangement in synchronism 
with the operation of the intermediate tray. Further, 
it is possible to carry out printing on the first surface 

30 of a copy sheet in sychronism with reading while 
storing only one page data for the second surface ; 
thereof in the image memory 4. 

CLAIMS 

35 

1. An image processing method comprising the 
steps of: 

storing.document image data in a memory; 
operating input of character image data; and 

40 processing any one of said character image data 
and document image data in such manner as to 
reproduce the other image in an area other than the 
area for reproducing one of said document image 
and character image. 

45 2. An image processing method according to 
Claim 1 wherein said processing step determines the 
position ofsaid character image depending on the 
position ofsaid document image. 

3. An image processing apparatus comprising: 
50 a memory for storing document image data; 

means for input of character image; and 
means for processing data of any one of said 
document image and character image in such man- 
ner as to reproduce the other image in an area other 
55 than the area for reproducing the one image. 

4. Ah image^processing method comprising the 
steps of: 

storing document Image data in a first memory; 

processing data stored in said first memory; 
60 storing said processed image ^data in a second 
memory; and 

carrying out print output depending on the image 
data stored in said second memory. 

5. An image processing apparatus comprising: 
65 first and second page memories for storing docu- 



ment image data; and 

rineans for processing the data in said first memory 
so as to reproduce the image with rearrangement 
and storing said processed image data in said 
70 memory. 

6. A copying method comprising the steps of: 
reading document image data; 

storing said read image data in a memory; and 
putting out the image data in an amount of plural 
75 number of images serially so as to copy said plural 
number of images on one and same sheet. 

7. A copying machine comprising: 
means for reading document images; 
means for storing the read image data; and 

80 means for putting out image data in an amount of 
plural number of images serially so as to copy said 
plural number of images on one and same sheet. 

8. An image forming apparatus comprising: 
a memory for storing image data; 

85 means for putting out image data in an amount of 
plural number of images serially; and 

means for controlling said output means accord- 
ing to the feed of sheet so as to form an image in a 
determined position on said sheet. 
90 9. An image forming apparatus comprising: 
means for reading a document; 
means for putting out a plural number of read data 
serially; and 

an intermediate tray for refeeding a sheet so as to 
95 perform image formation on both sides of said 
sheet. 

10. An image processing method substantially 
as hereinbefore described with reference to Figures 
2 to 10 of the accompanying drawings. 
1 00 11. An image processing apparatus substantially 
as hereinbefore described with reference to Figures 
2 to 10 of the accompanying drawings. 

1 2. A copying method substantially as hereinbe- 
fore described with reference to Figures 2 to 1 0 of 

105 the accompanying drawings. 

13. A copying machine substantially as hereinbe- 
fore described with reference to Figures 2 to 1 0 of 
the accompanying drawings. 
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pattern data storage circuit and a retrieving circuit, and 
extracting pattern data by received code information and then 
synthesizing it and image data, 

CONSTITUTION: In a facsimile transmitter 3, only necessary 
information which is entered not in dropout color is read by an"^" 
image data input circuit 5 and after data compression, it is 
transmitted together with code information inputted to a code 
input circuit 4, A facsimile receiver 8 stores image data in a 
buffer 10-1, and the data is expanded by a data expanding circuit 
I 11-1. Simultaneously, code information is applied to a retrieving 

circuit 20 to read pattern data based on a code out of a storage 
circuit 21, and the read data is applied to an OR circuit 12 
through a data buffer 10-2 and the data extending circuit 11-2. 
The OR circuit 12 synthetizes the image data and pattern data to 
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